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TECHNIQUES FOE DELIVERING COORDINATION DATA FOR A SHARED 
FACILITY 

CROSS-REFERENCE TO RELATED APPLICATIONS 
|(S00IJ h < \ s !. i i i \ ^ j , 

forth herein, under 3$ U,S.C, §i 19(e). 

STATEMENT OF GOVERNMENTAL INTEREST 

limn) This invention was made wish Government support under Contract No. 
9900406 awarded by the National Science Foundation and Contract No. 02129002 
awarded by the Teiemedicine and Advanced Technology Research Center (Department of 
the Army). The Government has certain rights in the invention. 

BACKGROUND OF THE INVENTION 

L .Field of She Invention 

J 0003] The present invention relates to systems for coordinating the- use of a high 
valued facility among many persons, and in particular to measuring conditions and 
deriving availability parameters without human intervention for integrated display, such 
as on a magnetic whiteboard with manually entered information. 

> « 04) 1 \ << n rat ng on (OR s ) 5re valuable factories I has bee, estim ed 
that io typical hospitals, the operating rooms account for about 40% to about So% of 
re venue from patients. The operating rooms also account for a large share of the hospital 
resources and expenses, it is m the interest of the hospital administrators to make 
maximum use of the operating rooms in their hospital such as by minimizing the time 
from the exit of one patient to She entry of She next patient. However, the use of each 
operating room In the hospital requires the coordinated efforts of a large number of 

ge nurses, cleaning . stai equipment m i m'enance stan" md runners Lo 
' ^ s 1 - 1 ^ v Uingroon team must 
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often complete the person's or team's own task before another person or team can use the 
facility. 

=§005| For example after > procedure on a patient is completed, the .following sample 
actions may take place in sequence: the patient is prepared for removal by 
anesmwticeodst;; and r : nr.sea;. for example by disconnecting the paheni boos anesthesia 
delivery equiprees';; and covering the patient; the patient s removed from the opeoiimg 
< ' v. and the operating room and its operating table are 

^ cuoee ^ «. 

acho:os may take place o sequexsee: the cleaned operating room and table ere prepared tor 
i d tools to be used in the next 

prepared for the procedure, for example, by receiving anesthesia from s anesthesiologist 

^ f i 00 Si! o 

qtsfoins r OR nurse Oi h® n c surge tfoeg reureop a i < ><. 

v. > > *U n u'r'pie aeopk, resources, and patients to 
( } - ' { ><■ >jNtpis , Jreieorm 

' ! ,;,A, e •» ximg K - - ready to act when the room or patient is in a state to be 
acted upon. 

|000€j v I s> to plan 

and execute if all procedures - an operating room were predictable with eeria.mty. 

- ^ ' " vexating rooms can deviate in both number and 

- * ^ i u x ftwi average or planned use. In contrast to most 

^ - j' 3!g in a trau m ce * * 

Much of the decisions on surgical case scheduling m trauma centers are made on the day 
ts P s N s v nng rooms the scheduling is usually determined 

^ > , * ^ svho c ct i Mht , < ! 

. r wmm! , - ^ are required. As a consequence, resources are 

vasied as perso; t >> nt v og t>c t that s fox the i s > £ 

are occupied jjj another operating room or area when their action is required next in a 
. \ room to example, jf a procedure ^ > - 
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1 l \ S 1 V ! „ >. V v. 

oom s ea<. - - s ibk minutes of opt i 1 * N d n a c os, 

PM)?1 \. s «g }« ;e takes req c $ 

v i t 'llH, V ' ! ^ v V 

' e, ; , \o ' , * „ , s »t ' i e< S 

t vtk Ld I v r * d x v ,, v 

r\ attired in 

id g< v ally So go ins he operas - >ms i'heo do not 
have eiuncaS duties ouhnanly, although they often have extensive ohnicai experience 
v * , s , ' < v - v ^ - sfnft ami v.o 

is change nurses prin attain in the vk 
sypie-aliv located in or near a eoro'd.or through winch surgical patterns are brought in. 
|0(H)8j Examples of changes afrecting the planned surgery schedule include cancelled 
s xpe which result from b wty admiftet 

an operating room); multi-patient tratjrna ? u -> \ in which demand exceeds resource 
supply, ai leas; ieosporarhy: atsd any external variables n operating room 

operational stalus (unavailable or malfunctioning equipment, Sack of stsophes, and 
' \ s Sr -Mused r>> Ihvss delav«o 

>* ! > < v\j i m at opv.<t'5 j v us \ t 

< > >< 5 *t o -ni ,e=e if c;, j\ w;ati be measure* id compared, 
v v s is ae person,* i > v s > s , t 
on time - so called "on-time OR stuns." The industry average for on-time OR starts is 
27%. The best performing operating rooms have on-time OR starts of ?6%. Clearly, 
there is room for improvement at all hospitals. 

> b,empk ea m- a suite of operating rooms that exhibit good 
performance, the charge nurses use a large whiteboard (365x! 22cm) in front of the 
< - i eb i is us i.rt show serg chedui.es 
1 - • . p n-, v n> \ mark he strip 

s s ^ s< s h i ». < , s sprung 

-ed or updated to indicate the current status of the 
v\ v . Mo he hand en f 
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u react , ^ ! v i ? sv 
! < <• , s, ^ i ^ v kt\r>* «h< < v, f 
v. v{ vntienon papers taped t i - 

s or tokens are also prepared tor various staiY positioned on the whiteboard 
according to their availability and > a 

'■(Mil While providing a useful place ibr recording and exchanging inlbrmatiosj 
about the use of the opec abort morns the wboeboard ha:; souse shoricornings. Updating 
the wbheooard ragoues human interaction Thus the svhiieboatd ts subject to failures 

nu-< r\n\ t r ex 

repori new uborniabon dan ;o forgetfuhiess; distraction by persona.;, eniosiooai or urgent 
event:?: physical reparation froni d e rvhiteborrtd; or motivation io delay repeating 
;aion-nanen (tor example, to prevent ;he early < t f of a rest break or roeal break a 

iOObb , > , v ,t bo i - 

remotely. With rite addition of audio and video. Ore t u , \ t, could monitor ibe 
- viito ' r ^ d\ s - v^esso'f 

singers and estimate when a procedure might likely be completed. Additionally, 
viun ysk ogistscoidt sober dr il i tasks bettes b) ltd is low--* afcload periods 
better. 

iWBj While improving the availability of information about the current: use of a 

deo and audio was found to raise serious, or; vacy 
it a< asuai co i rh< a ox \ ? roo is c t by those 

it participants \ ibibiied r s ! n it t f 

e ■ ^ * t. s , k > jv? t.-> »E)wen ai:d unknown observers. 

* \ a s f ? ced neorophysio legists could dets 

di i s d t\ vcre 

not appraised of the progress of the procedure or warned when a procedure was 
completed or a patkr;t was being prepared for rernova 1 or g:ven estimates of when their 
reaci action would likely be required. Thus other personnel slid had to guess when they 
<- n. i >. t v. i ,vit A T«?ah 
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about operating rooms; that does nor suffer the disadvantages of previous approaches, 
such as subjective updatorg, loss or privacy and discretion, and lack of predictions for the 
time of subsequent actions for ail conceded staff, among other deficiencies. 
|O016J s , ! 

unbonanoo aix-nt other high . facilities that are used by -ei persons tn a 

> vs ' o suffer the disadv.n ^ ^ „ ^ h s 
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SUMMARY OF THE INVENTION 

use of a facility. These teehnirpses remove one or more deficiencies of previous 
approaches, and can ereuove the efficiem use of high valued facilities s as hospital 
operating osoms and emergency response resources. 

joe po; in < set of embodiments; a method ibr delivering J > o , \ *"! 

i s ■« s producing conditions tlata by s t surms - hots 

human taterven i i coordinated among 

" on ,>>< < s ^n^'V x I s. , ! 

X< X X ^, > V Svv «. > 

^ I k e v^boa»rv ^ inpiove 
m ^ . s i a T p;ov>Usng 

information to all panics whose uses of the facility are to he coordinated. 
|00 19] in some embodiments of this set, the facility includes one or more trauma 
center operaoug roonis, surgical openumg rooms, emergency room suites and cardiac 
cathoieruaimo hibo; atones,; and the parties include medical doctors, trurses, medical 
technicians and orderlies. 

[8020} In some embodiments of this set, the method further includes determining a 
party who has access to the coordination data at a particular time and a particular level of 
privilege assocreieo with diet party. 'Hie step of generating the availability data secludes 

X ! ^ >i > Sv., S , o t ? V i 1 

detail. \ < < the particular 

level of privilege of the party mhh access. "Ihese embodiments help protect privacy when 
oibooog highly revealing measurements of faebiiy conditions. 

[0021] -i si i , ' i , 

of the facility, in some of these embodiments, generating availability data u o , 

i * f 1 i i m re ^ . i 
otpect a; the image data. The cartoon view is presented \v;0h the coordination data instead 
of the snore detailed images of tire facility. 

10022] ^vva x-J 5s jy > i j \ t x k 

from lite conditions data a status value among multiple status values for one or more 
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tatus parameter, patient stews parameter, operasinp room 
tt > >a a netei 

of this set, schedule data thai k < > < planned -use for 
u-: coordination date includes a display element that 
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a? each boat ton where 3 color of the low passed image faffs within the range of colors. 
KH)25| i« another set of embodiments, a method lot ^ * , 
actual use of a facility includes presenting a first bar that indicates time for planned use of 
a iacsihy. A second bar is presented for elapsed time of actual use of die facility, which 
extends at least in part outside the first bat. 

{mi6l In another set of embodiments, a method tor inputting data to a computer 
connected to a video input includes caponing a video image of a two dimensional surface 
including a manually positioned tangible token. Either a location or an orientation of the 
tangible token, or both, indicates one state among more thai! two possible states. A 
particular state of the possible states is determined based on the video image. 
{0027j in other sets of embodiments, computer-readable media and systems perforcn 
ihe methods described above, 
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'BRIEF DESCRIPTION OF THE DRAWINGS 

The preset in vention .is illustrated by way of example, and not by way of 
lisniiaiiom in the Aguces of me accompanying drawing* and in which like reference 
numerah. rati;;- ;>:> shnisar elesrsems and m which: 

mm FIG. 1 is a block diagram (hat illustrates a facility coordination system based 

mm FIG. 2 is a flow diagram that illustrates at a high level a facility coordination 

I083J] FIG. 3 is a block diagram that illustrates at a high level a facility coordination 
system, according to an embodiment; 

|8032] FIG A s o . ■<.-. - $ s ! u,i s a o hn m < > ! < 
v i . otnej untx?dirnent; 

> co ling to an < mb > mem 

{0O34j FIG. 6.4 and FIG, 68 are block diagrams that illustrate switch tokens for & 
user •merface. according io embodiments; 

10035] m. 7A is a flow diagram that illustrates a facility coordination method using 
^ s ~ f nK 1 meet; 

|0836| FIG 7B is an image that illustrates a sensitive detailed view of an operating 

100371 FIG. 7C is an image that illustrates a Jess sensitive, cartoon view of an 
, - . , »< v \o ding lo an embxiirnent; 

100381 FIG. SA is a flow diagram that illustrates a facility coordination method using 

* to ar e mbodraent; 

10839] FIG SB is a flow diagram that illustrates a method detail of the facility 
coordination method of FIG. SA, according to an embodiment; 
10040} FIG 9 is a flow diagram that illustrates a facility coordination method using 
noi> intrusively measured equipment operation data, according to an embodiment; 
10041 } FIG. I OA, FIG. 108 and FIG. t.Oc are block diagrams that illustrate plan 

l ' N > x S OS i. . \<>i t n s j 

|{*042j o t , (N( ^ t > 
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DETAILED DjESCRfFFION 
|XM)43] * iei\v r r\ ^ * ct n» 

multiple pasty use of a facility. la the fotlowmg description for the .purpose of 
explanation, numerous specific details are set forth , ocder to provide a. thorough 

1 of lite \ ^ - o invention. It , be apparent, howevet, to one skates; m the 

avoid nnnecestaniiy obscuring the present < m , 

mm In particular, embodiments of the present invention are described in the 
context of a whiteboard display in a control area of a sstttc of hospital operating room;; 
(including trauma center < rooms or both 1 >weve.r 

< Uixt Other embo^ 

^ v t ! 1 j t c< ! <3ii, „ s < ^ 

O) ?J < { is otim'o^ ltd (i - ,uk n 

emlxdimsnts of the invention are employed for facilities beyond the scope of a single 
hospital soeh as emergency response facilities distributed among several hospitals, 

** ^ f m r - obile units (such ^imhuatxe fire trucks, rescue boats) 
utilized by emergency response personnel such as policemen, firemen, Coast Guard 
personnel, National Guard personnel and regular military personnel. Other embodiments 
1 J ' " - f ^>cd i>t non medical facilities used by multiple parties,, swh as 
> >>» >< >fine! such as aircraft preparation personnel including 

^ " !< uiuMkiin^^KfdVhurK awf security* 0 

ao\ ^ 

The generation and use of coordination date is illustrated for an approach 
feboard. FIG. 1 is a block diagram that illustrates a facility 
5 ^ s !! 1 ^ - V c - - ! * 1 102. The 
* N ~ lv s ! ! - < s t n u „ ,t\\ to the 

s '» e _t -. v L ,o, te not limited to a centralized magnetic 

°> ~ ; ,>% - ' " c o »j coordination data or user input or both, bnt may use any 
centralized or distributed input/output (I/O) system to display coordination data or to 
receive user input or both. 
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|0046) Whiteboard 102 is divided into different areas corresponding to different 

> ! s\ I 1 V ^ ^ ' 

re; - H0a ; 1 1 Ob, 110c corresponding \ s 

OR 1, OR n 5 'is <. -e ' ^ s , 5 i * k t s 

t ) lit )u d^t) 

ercina.s $rs 4 4b 4 < ec % * 



are;; \ - •, 

available to perfonn actions ia the operations rooms OR L OR 2, OR 3. hi other 
k Mtals { « board s be divided into nore or different areas 
fOS4?J Magnetic objects are attached to the w uk board 1 

s> s ! K * S ) i <. S SO v. I V ! < 5 is 

! - ?s nor.s 

magnetic personnel object 124. Magnetic case strips 140a, 140b, 140c, 140d, 140e, 140f, 
» t *k cast ssrps- 140 a on, i s> s * 
' ^ . >u<, s 1, \ bit. rooms OR 1, OR 2 and OR 3. Case 

s 1 >\ \d description 

r bans Wf ttenom i s rips 40 

lb v,oaico!n emiy jk - oper mon 

rooms OR 1, OR 2, OR 3 are represented by roagaedc personnel objects 124 in the absent 
memtxrs who ,k 

rooms OR i , OR 2, OR 3 are represented by magnetic pexsonnel objects J 24 in the st&ff 
area 120 o >sem area 122. Staff tnembt rrentl> ss vo a 

N ' N s ^ , v. , ; . O j s I , sec t 5s magnetic 

rea HOb, 1 1(\ t 
^ ' ticel s eseated by ma c > * 

■10- 
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L~ t <. v o N ! i * \< ! 

, > \ v vML shitdxmUrouku^ea 
printed and taped to the: corresponding staff areas 120, 122 of the whiteboard 102. 
(($0491 , „sv ■, , e <. v ^ u x 
~e>Sv s»nps 1 -O 

embodiment, magnetic case strips 140a in ate ) f2a holds information related to the case 
eorrendy m progress ;:; OR b srsii magnetic case strips 140b m area i bib bokis 
t 'onoatv 1 1 ^ 

v es. ^mhoon-m* i >~ i. < , < s„ | s4K - 
<\ one «\ iu wise s^edrtled o: CU-i K " 
* adcK information related to the next case scheduled for OR 

scheduled for OR 3. Other information related to each OR or the eases scheduled for 
each OR may be wr;aea manually with whiteboard markers or printed arid taped to the 
ftfnieboa d 102 

100501 The whiteboard ara:i magnetic objects arc easily manipulated by humans and 
caa be adapted to provide other or subbe nuances in information. For example, magnetic 
ease strip ;40f is positioned to substantially overlap hobh the hi progress area 1 12c and 
I4( for OR * to indicate that { tftise s arret > it 

prepared foi leORprec \ < jatient is in the room and waiting to be 

s est jipn te case is not yet in 

1 m ease to v »ch the patient is still m a holding room. 
Whether the left sale or the right side of the magnetic case strip !40f it in the in pi gr ;s 

tK „ m > i« mat eed vvsth the 
case m Jb,n!.\i\ st >~ * , ;:e.,\m- 

^ m ! ■< < ! . s s v y\i - y - < , k 

> m > ! ( a -a . or • ~,vse ^ O- ~ >•> a ' s f tac \ >e awm 
monitor, 

^ t s i >ucGi.p5cte< t 10 

has many useful features However, it suffers from a reliance on human input that is 
'i\r ;. , x s jjrt, uror, or hidden motivations. 

-is- 
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I . 1 n ,mm\f Overview 

H?052j FIG. 2 is a flow diagram that illustrates at a high level a facdiiy coordination 
, < ,\ :, c: Mi 2 >> s 'JAaTit^s' 

diagrams ;ne presented in a particular order for purposes of dhisiratiom m other 
eraboa;men:a one or mere s may he performed in a different order, or may overlap < 

embodiments, overlaps steps, 2 i 0 or 230 in some embodirnems. and is performed alter 
step 210 in some embodiments. 

f > fanned ?e > th faeiiitv s >btai ed ! h;s .rdomiarion is 

planned use: and alerts may be sent if uhe acncd use deques too far from the planned m;e. 
orm,npe i*so e< \tm< ms or step 202 eheduk us om 
„h,m s i q sl^ruo i,t a \5 ji\ Ifculkiu compete; . » . 

scheduling systems to manage schedules of persons or facilities or both. Snob computer 
tpplicatien efts us i ).l or distributed database * s boat plaoaec 

< 1 ^ f 'M. Hi >U 

^MV<\: Hh ? its f t 

lor ear v s g mors tie- n i date, a star* sme, or a sequence of c ses to 
»! N , ^ f) o*yui tf( , are ^t,re\ n 

«. ed fit son e 

N ' v v Uv v v not used and step 202 includes deriving operating room, date, 
sian < sod sequence of eases osmg opdeal character recognition (OCR) n\n 

t * onto t whiteboarc ^> t 1 <j to tJ 

^ i s mMf<\ 5 - ■< ? to the 

system 

! ^ ^ m . > i " xiuced based on r\e > ,jt v 

> may also be used in step 210 I or exampfc data from 
qx ma ms - iectsd sc n j 
video data, or some combination, is aiso collected daring step 210. For example, one or 
more video cameras are installed in each operating mom arid holding room and image 
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she nejft pattest at a nine three minutes in the future. Such predictions may be permed 
using * known method; for example, usmg statistics of ! average delay between a 

* " ^ 1 ' K l ti t J if tl , , fj j, j 

operating room, suite of operating rooms, or iadas&y averages. In some embodiments, the 
present or predicted status ts accompanied by a measure of precision of the status, sceb as 
8 of ^curacy for table conditions derived from images or the standard 

deviation of delays about the average delay between empty status and ready state. 
mm For example, in some embodiments, the availability date generated in step 230 
includes producing an operating table (also called an operating room bed) status, hi this 
embodiment, the values for the operating room table status are "empty/ 5 "ready;' "patient 
table," "drapes-ofC "drapes-on," and "drapes off, after-ond" The "empty" status 
ndieaiea at) operating room table is not occupied and is not prepared for a new 
upftnt The "ready" status value indicates the operating roam table is not occupied and 
spared for new occupant. The "patient on the table" status value indicates the patient 
n the OR table. The "drapes- off' status value indicates the operating mom table is 
upted and the occupant is not covered with a surgical drape. The "drapes-oa" status 
£ s occupied < nd the occupant is covered with a 
pea; tirape. Surgery ss perfonned only after a surgical drape ss positioned over the 

! s value indicates su cry doss ibe end ar 

em is getting ready to be moved out of the OR. 

??! The status value is determined in step 230 by image processing of camera 
gee mat septet me operaPng room -able. Based on color and texture data derived for 
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^ \ ^ ~, : 

known position of the table, and subtracting out the effects 
•aisiig room between the camera and the tabic. She status can 
is y v <n some emb v tv » » s v v 

ixel (RGB v , < % f >;>■ 

1 ;;-.!&)■- ;;nage variance j. < , for nghm;g changes 
" Edge detection routines {such as available in MATLAB of 



we raoie ft'i; - s ne wnh the previa s n 5 , w < } „ 

i , ! - > X 

'>drapes-Qff» status is determined it; some embodiments by identifying the bed area first 
k emp<, texture and color w i: . he vain , in e \ d area For 
eq« ! < s, the image processing pxocedi orrecd 

identified the "empty" status 76% of the time, the "ready" status 80% of the time, the 
"dmpsa-on" status 67% of the time and the "drapes-ofT status 57% of the time, 
f00S8j .hi embodiments that include step 202, availability of the facility includes 
infomtatioD about how tar the actual status deviates from planned use. For example, 
availability data is produced that indicates the operating room table is ready for the next 
patkn * m of * csrf;5in tiiTie 15 «fcht minutes later than the planned time for that 
> s e ^ be to be ready. 

10059] to some embodiments, the data collected in step 2 1 0 is considered sensitive 
and not for general consumption among all parties that coordinate use of fee facility. For 
exatnpie, full resolution, video images of the operating room during a procedure or 
preparation fox a procedure are considered sensitive. In such embodiments, step 230 
includes producing one or more less detailed views of the sensitive data, such as a lower 
resolution image one fourth (1/4) the height and width of the full resolution picture and 
" s v c ' ;> ' x ' m ptvds and no audm, or cartoon images 
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step 250, the priv: 



persons who have current access to data displays 
axampie. in various embodiments, a > types s a personal 

" - i f ^n ' a u 
5 ;he 10 C3r;i -° * camera; or a user gives a sample to a detector for a 

-14- 
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s n based on a unique physical ei aractei istie such as a 

}ge. In some < all parties who cess 

to displayed data .may view any data collected and displayed; in such embtxhmems. step 
250 may be omitted. 

|t«^i: - 271; coordination data based m; the availability ! . ss made available 

x fo s ~ i< b \ 

runners tech i v v t 1 

eoonismeoon dou ike^e emlva. < 's om ^< - , ^ , - ^ e^ m-m 

* d tinted in some 

v Xfronv'aon da i 

the persons bavin* access to the coordination data a; a partkmlar time. For example, if a 

250, < a high defaced mew of the sensitive data ss displayed n>; a short period of time. 

d as a defau mditkm a I perso ha.va c so 
^ s s. detailed views for > i < . > 

f s i if a person with a higher level of privilege is detected, i a view with 

. so is ad hi some embodiments, the r. i da- 

a iOtVi s si t st i - in 

some embodorserits, the person with higher prmhege roust also indicate, a desire for the 
greater detad view, sach as by keying input or moving a token on the whiteboard. 

» system is corn; s c tr note 

tote. < > vvbas<dat 

^ 5 2 v >rd i t A on board (such as an image of the white board 

s o s-n sda-xi the coordination data. Step 270 also includes 
v v. I .'o^imiu o kf, \)evspia\ 

devacs the note s rr c he rcsno spiaj s 

2. Structural Overview 

$0S3J > 1 n d js ) jg 

system 200, according to art embodiment using server processes. The client-server model 
of composer process interaction is widely known and used. \ \ > * to she chent-server 
tnodei. a client process sends a message secluding a request to a server process, and the 

oiUurt a 

-IS- 
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, „ , ^ * n ,n on = , > s ^ «. ! N ; 

! , s v. " a v. a v < s , 

,\r.i' one o mors protocols for : v x > >m . -.m ' en The lean "server" is 

or which the process operates. Similarly, the term ^ v. £ is ooovem.iosxdiy osed to refer 
to rhe process that makes the request, or the host computer or; which she process operas. 

X s , ' f vO x f i ii ! - 5. si 

- iiov vos tvAt i i v , u s 

a server- ceo be brokeo up so rue as multiple servers or; multiple hosts (sometimes catted 
tiers; for reasons that include reliability, scalability, and redundancy, hot no; limited to 
those reasons. 

s 2 >a one 

displays 360, " user moot device 
bodimeots, shots or fewer components 

rs 352 are distributed among one or 
more hosts 350 connected by network elements foot shown). Facility coo rubra doit 
servers 352 perform the stops described above k: mafnod 200. norther details for an 

vsbodsmem of facility coo ^ e described below wit reference to 

FIG. 4. 

* 4 bsv v . - 'i i i i c i 

^ V s , o ^ ud< >m« or moire cameras 312 or one or more other 

sensors 314 or both, as will be described m greater detail below for some illustrated 
embodiments. 

I&0671 3 s * t ; 8 provide .'it, nicatioo path 

' s t > v, ewoi Ihks 

\ . *- r i ! i s u *< oo 

N v v 1 in om rjo >piri' 

by agents outside the facility to protect sensitive information, fit other embodiments, 
sensor dote loco; network 318 is omitted ax! sensors 3 1 0 eommamcate directly with 
.facility ooordmabon hosts 350. 

-16- 
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eqsripmem 320. networks alb, 328, 338, 368, 378, 

\mm\ One or more facility coordination serves 
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}0068.| T f y equipment « 

si. -s V Soroetr* i 
over a network For s mpie, in hospital operating rooms, eqnipment 320 includes 
anesthesia eqmpmam?, rad:olog;oa; cqmpmem, patient mosmoring , < v u 
apamsums c 

5snCtW<!iJ 

database servers to store patient data collected by paiiem mommting equipment Any 

^ <. S u \ V !! ! > s 

!s phwudrv ^um 



some embodiments, ner.-vorks 3 id and >28 am separak- and distinct networks, in some 

< 1 > s M , V ) j fH !i.U ( ,p| U !l Utir O- t\ , ,j i}K 

10070] Displays: 360, including displays 360a, 360b and other displays represented by 

ps;s 3t and displays 7 < b ai d ot < - spl ss 

represented by ellipsis 371, are used to prefcnr c^o . \, ' — • s \ , ^ 
s >> - 1 - I e t <. o s x K . , ^ 

3b0;:o memoes a projector for projceimg images onto a whiteboard, each as control desk 
! i , v.mho«iiHeci 

etab beleov \vdh ererence. io FIG 5 in other embodiments, mom 
< m >n ot) - '0 are used. 

I&071] t > , x ; ud oord seenre network 368 

>s m "tn tractor m i\-,h cm 
s ,60 \nx r^fv ^ < i. s 

t KW-. <■ s >tvg iS 

V \\ , s ^ s j <■ < j 

otdsme dm iacrihy g> protect sensitive information. Displays 360 are in seenre 
, -. ,^ n v s„ as i ! r t S^ 

-17- 
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private network ( VPN) on a less secure physical network, - >vm a wide area network 
i W *> , , -s V* 

? 0a secure com wmcation wi& factlit} coord ! a oj 

sewers 352, and do rot present high detail, highly sensitive coordination irdbrm shorn m 
some embodnnews, coo:dio;it;on data open neovotx 378 is a wireless local network fox 
reaching displays 370 :hat o!eh.ak hand held devices throughout the hospital, for example 
i ' < > In son, \ >■ 1 

- vft Internet or a wirete k * ea na v> > x. to 

ctmbinatkm, 
8 and 32.8 are 
wo*, 378 are 



device 330 includes a keypad or keyboard connected ;o a terovlnal with one or more of 
displays 360, 370. in some embed; , user , ' . 330 includes a card reader, 
either a. Stand alone reader or on e connected to a terminal with one or more of display s 
r as vs s not di \ ^e \&> ma i m B one o ■ more tangible 
tokens, such a magnetic tokens moved on the whiteboard 102 depicted ia FIG. 1 . The 
! s * ! .0 ( < v 0 s d 

reference to FIG. 5. Although shown connected directly jo coordination Snows 330, 
other embodiments, user Input device 380 communicates with facility coordination 

, one o; more other networks, such as networks 31-1 328, 
368, and 3/3. in some emboriimerm, user repot device 380 ;s omitted. 

" N ! se wwtt lo <, t tonru«;raaoh^no' n<u p u fees for 

vhedthet, t> is < dw ised 

" v s^ v. ^ , used. 

160701 v s » i 

schedule database server 330 to ci:e;as that use the server, such clients on hosts osed by 
hospital adm;nistrahvs staff, charge nurses, surgeons, and maintenance staff. Any 

•18- 
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■• •• -stay be used including LANs and WANs. As 
nsasOaieo, raemty coordination servers 352 are connected to schedule data network 338 
using one or more network links 311; for example, facility coordination serves 352 
include & ellesl for the schedule database server, as described in more detail below, In 
some embodiments, networks 338 and 318 or 328 or 368 or 378. or some combination 
are the sunn; or share network elements; in some embod<nvo-!s " <S ^--d ^8 ^n •• -^,a 
358 arid 378 are separate and distinct networks. In some embodiments, server 330 and 
network: 338 are not included in a facility coordination system. 

3. IN s d n 

mmt FIG. 4 is a block diagram that illustrates at a more detailed level a facility 
coordination system 400, according to another embodiment, in the embodiment 

3- 4, the sensors 3 10 of FIG, 3 include cameras 410, including cameras 
cameras indicated by ellipsis 41 i . The sensor data local network 
s a vrdeo data local network 418, including video image hub 418s 
er 4 1 8b. The equipment 320 of FIG. 3 includes vital signs 
! «W»^nt data local network 328 of FIG. 3 includes 3 vital signs 



nd othei 



both on bos- 450c. 



. 3 include coordination hosts 450, 
coordination servers 352 of FIG. 3 include 

f pturc server 4M on h< 50b 
I'lOihtv < nd <. 



m9] Ths 360 » f 3 Eludes projector 460 and whiteboard 484. The 

user input device 380 of FIG. 3 includes card reader 482, tangible tokens 486 00 
whiteboard 4-84, and token detector 488. 

PJ80J Cameras 4 i 0 provide image date for areas both Inside and outside the 
operating room. Any cameras may be used. In some embodiments anaioc video earner* 
are used. An American convention for analog video signals, designated NTSC provide 
three anstog signals representing hue, saturation and brightness values (HSY code; for 
scanning across a display area of a cathode ray tube, in other geographical regions, a 
different convention for analog video signals may be s 1 some mbodimems digital 
cameras are used, which typically provide three bytes (24 bits) of data representing red, 
•19- 
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green ami blue values (RGB cods) for each picture, element (pixel; of an image 

i i f ' * \ M Aumui P 1 ! s { s 

us as a hitman of red, green, base bases us BMP Euroae in some ernbodiments 
compressed ROB daas as produced, using a compression scheme. Guy couipression 
^ s x may be used; some well known compression schemes include digital formats 
designated by she name;;: graphic;; interchange forma; (GIF); tagged image die forma- 
(TiFF), and urniS photographic experts group (JPEG) for i , u images n < >\ > 

> - s v ik i a? one 

camera m each of three operahng «>oms and one camera directed to produce images of a 

« K Is N t ^ , Kim H< if ) i ! U U V Ow 



equipment. In some embodiments, a camera js pointed at each foci locsmm in a holding 
or staging area, where patients are iaKen before they are brought into one of She operating 

10082] The video image hub 418a is connected to each earner* to receive she video 

s 1 N o i output on one or 

uorecon i n channels \ny kaown video hub may be used. The video 

' > u ' 1 ! , vtniue which 

input signal is to be ontpui for how bog and which destination en dae network is to 

s retwork switch or tout <, i > 
switch/router 4 18b. The video sw-tch/rouier 418b is controlled by the image capture 
server 45a < wt 450a, as describe so mors detail below. 
|00S3j The vaial signs monitors 42(5 include monitors of heart activity 
(eiecirocardiograui, EKG), blood oxygen saturation (SaCTfo nom invasive blood pressure 
(NBP) : and body temperature (TEMP) in each operating room. Any equipment may be 
v ss-rn \ a usu . <. r\Go,t p 

heart rate (H8 \ I B) data SaOj data, NBP data and TEMP data are produced by DASH- 
' ' d v , >nan t 3.'\or\ 

V V , s. S N ^ I" ,lv l'W\!v 

\ a . - 1 . s , i . vO ! s , 
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centra! data repository and server (not shown), where the vital signs data cars be accessed 
0; cc:u ' N " wmtai st 1 

^MkS4] the iraage iaptnte serve 452 t - «ro deo swift mer4.^ 
The selected video output is mammaed to the image capture server 452. ! some 

> i . - " , \ „ ^ \' 

. j * r w v ^ o- - v v x ;\(\ m o 
different coding type, color separation, clipping, Oik-ring,, digitizing,, decompression or 
order provfsssoe steps, fire image capture server 452 commonicraes with die availability 
and coordination > server 456 on host 450c to k what images to capture and 

sjw me processed _ 

coordination data server 456. 

[ms\ hi the Illustrated embodiment, the vital s;ens canmre server 452 cheeks 



fe i ^ > C! )■ s - . 1 M,i s i_J s ,w r^ ! <. < , t£< *• 
\ &v 3 i u -> * tht ta! gns 

^Oi^m - ... v 

> ! 4><s eommumvanw * , > ! n v : tduk database 

1 s ^ • >n data server 456 receives the processed image 

la t "o n tfx n get n -ore sers ;j i52 , she pj messed vn I ngr s data fro n the \ ital s i ns 
.capture server 454 and the schedule data, and determines t>v < ^ \ 

tsttrapie, values for params te table status and patient status are 

determined arid predictions tor the next stage of activity are derived and low detail views 
s v , eviuoed .A subset o to, 

1 o ^ > \ s , m mm tn >! u \ c. ^ - m lacxhty Ik 
^ % s ^ k , v.! i h ' < ls g the; 1 mm <~^k hi 

other v - v fe no, a «. *\ v n w , , en 4^ ot serve; 4r<b 

comprises multiple servers which are distributed over several hosts or both. 
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|C*08S| Whiteboard 484 is any whiteboard that can display a projected image. In an 

^ <J s " S t < } ,sV 
, S< , \ 

'*>n .Projector 460 ss used to project an image thai presents u , v , data, Any 

^ < v. is v > % »< 0 I s s ^ 

S »» J *N4 ^ 

described m more detail in the next section with reference to FIG. 5. 

<; * s ased So read an utenUleai-en eatd he < , 

she sysrens in order to determine the identity of a person who am view Use coordination 
d.:i i s 5 , s, 50W n card ; ;ades £ s i sjsed In some embec o s , - , , r 



'.ompmer. 



:• ;tt: 



vsid r< 



> ' ^ » ! , S ' s tv< 

^ s ^hiU < s:d using any method known in the art, such as by magnetic 
forces or by adhesive, adhesive tape or mlcm-books, such as VELCRO™. Token 

s •* i s ; t <nown u the art in as cmb ' described k 
more detail below, token detector 488 is omitted and a camera 410, e.g., camera 4 1. Ob, is 
rrme\s e ■ ^\W>^ 5! j V \;.i\i- ; ji > dr , c o^u :\ tV 

s ^ NOrre embod * j? to detect 

1 <■ ' s v. \<.r 4r> -md n some embodiments the image 

^ ! i wb/ntv and coordination date server 456. 



a moos diagram fast mtsstms. 



s 124. In addition 1 ; 

vidgetf') projected onto whiteboard 10: 



s o-s; 
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10093) The presentation items projected onto whiteboard 102 include image data 
SiOa, 510b, 510c for operation rooms OR 1, Oil 2, 08 3, respectively. The presentation 
nerus projected onto odnieboard ' also include progress data 512a. 5 ?2h, - for 
operation rooms OR 1 , OR 2, OR 3, respectively. The presentation items projected onto 
whiteboard 102 also include forecast data 514a, 514b, 5 14c for operation rooms OR 1, 

102 also include other dynamic data 530. Although progress data and forecast data and 

illustration, so other embodiments, progress data or forecast or other dynamic data, or 

some combination, are presented in the same or ovedaprhrss areas. 

{0094 \ s f 

1 strated erabodmac e projector 460 am cover a large portion of whiteboard 

120 with a large number of rows and columns of pixels. A subset of these rows and 
columns of pixels are dedicated to each presentation item <> widget) For example, the 
projector covers most of the whiteboard 102 with 2400 rows and 3200 columns, and 
reserves one subset of 300 rows and 400 columns for image data SiOa, one subset of 100 
rows and 400 columns for progress data 512a, and another subset of 100 rows and 400 
columns for forecast data 5? 4a. 

mm Bach image data for an operating room, e.g., image data 5 1 0a for OR I , 
includes coordination data based on conditions data collected from a camera for OR L 
including a camera directed onto a staging area or holding area for OR 1 . The detail 
apparent in image data 510a depends upon the privilege level of a person viewing the 
interlace 500. For example, the image data 510a depicts a low resolution or cartoon 
unage derived from one camera in OH I If a doctor presents identification to the system, 
such as by swiping an ID card in card reader 482, a higher resolution image is shown in 
image data 5i0a. in one embodiment, a non-cartoon image is presented in image data 
al 0a. In another embodiment, the size of image data 510a is increased, for example to 
600 ro ws and 800 columns of pixels, so that four times the detail is presented in image 
data 5 10a. in some embodiments, one or more other presentation items am turned off in 
order to make room for the larger image data with, more detail. 

|0096| The progress data for each operating room, e.g, progress data 5 1 2a for OR 1 , 
includes progress data included i amiability data determined by the facility 
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s neat, faci * > ! stem 4 

< ' 1 \ S ~ O ( t v. t C" ! ^ *•! ' 

OR. s i >ptv or , re^dy t<\ , e 

. - ■ '\ o - i procedure is unde^x:- tma a *b'fo tmo mmxc 
eari ax. In some embodiments, progress data 5 12a also Includes a s v i j > v 

that the status ;s mcorreciiy deduced from the image data, e.g.. the progress data indicates 
' ihe table stains is "empty" ami s there is a probability of 10% m the sir-ays value 
is not correct. Vs method may be ased > present this information. 
|O097J The forecast data for each operating mom, e.g., forecast data 514a for OR L 
iooUides forecast data included m availability data determined by ihe facbhy 



) • ! ~ > ■ x \ . ! ;b i. i >b d x x< dot the s t k 1 r u i ' * a so v. .a k - , 
b 35 rnimnes m the ihtare. Fo < surnc s > 

based >n the- sta i 
>mt » ' i typical delays to remove ihe patient and ready the table fo? the next 
xsh'ent \xi) method msy b< c at this 

x x >tt i <s v< ><* a 514a also includes a statement of accuracy for the forecast. 
^ s%t 5 i c tdesa ime error asso ated wlti wo tanc d 

deviations about the forecast time based on a Gaussian or Poisson error distribution 
VN »* ' v v a eiraxi may be used to determine and. present this 

information. 

f0098j Other dynamic dais is presented in dynamic data 530. For example date and 
Jim* for the current moment is included in dynamic data 530, or a iow~resoiu£son image 
of the corridor or a general holding area is included in dynamic data 530. 
|(I09§| to some embodiments, the location of presentation stems 51.0a, 510b, 51 1 Op, 
5l2a ; 5!2m 5!2e, 514a, 5 14b, 514c, $30 can be moved around whiteboard 102 from 

i - to move mage data 

v «. s xxtttot' m foe n 
x e< ea 1 14b. in some embtx tne k 
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unique markings mid a tokcti with niarkings. designating image date lor OR 1, or image 

X k S * S d < ' N 

ihe v are not dbt:rjgt;js,b<-d bom each other. In some such embodiments, a token 520 
- i moved m , data > m associate . token ^ the image, ami toon the 
token is moved m in queue area 1 14b to drag the image data 5 1 Ob wnh the newly 

dynamic moa 530 a! she boltom of ni 102, Tokens not eurrenby used m provide 

> - h - ss<oc parked in a pari ice < . s aboard, lbs 

example the upper right or wmicboard 102, as shown in FIG, 5. 
10100] in scans embodiment, switch tokens that indicate more than, two states are 

a One bisecting one angle of me triang-t-Jar shaped token. The bisected angle indicates a 

s By pou img the b'seefed angle i o 
directions, dbmrem states ,:an be indicated. This switch token may be used it; any way on 
die interface 500. Foe example, < some embodiments, die switch 522 token is used with 

! < nji\ i>',\\»uhhcbw v m m grating 

room, to a second camera, to a third camera in a staging area for the operating room, to & 
i m n l .iShii'xn , f , ,v , m 

. ivn, respectively. 

101031 FIG. 6A and FIG. 6B are block diagrams that illustrate switch tokens 600, 
050, v < n f Dr a v;se r interface, recording to other embodiments. Switch token 
r s «. <■ < f 1 ' i c portion 

on-ec os > 1 m mm i > e m os mecp t a p,^ < <m b22. One or more 

mi k < ^ " oaareln en fiOand one or more markings 622 on relative 

< n steKwrf 

s x v „ s < , «ti 1( ,x' urno The 

\ s u n^ s jC ^ 2 , sf etoanu vs t o t 

m v T\ ^i, ,s „ vmoves ambiguity about the hvelvs steles doe to 
symmehw of the aneho; piece. 

f.61,02] ^ . k s . c ir MO ^B, „ o ^ s - ' 

if u 1 e *~ ^ m„v.e 
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The s vi ,\ distances from the relative poison piece 670 to the short base of 
wn„'iv s \ v k > of *o t te axis - v 

symmetry of the anchor piece) are osed by linage processing techniques to 

s l< N n m ge processi gi e mi m i y\x 

used. 

3.2 Image Das* 

The ( esord.si.n-v. ^ > <. 

bom image data on the conditions of ihe facility Si m by cameras 410. FIG. 7.A A f 
bow diagram thai iliostraies ;s Aomiy coordination method 700 using sensitive image 
< ^tn v i vi j 2i > 

v v s - i des ste tap 230 iiiel sdt sste * s< p ( < u i n< , 

. u step 270 nvcAdes siep 770. 

10104) in step 7S0 raw im; s e c «a fo an < >tnred. Any inett >d 

.may be «sed to capture the raw image data. An example of a raw image of an operating 
mo is d^p: \c n i As ?B HO ?B is a black and white version of a color image that 
illustrates a sensitive, detailed view 780 of an operating room, according to an 
crab ex i tn.be aeen in FIG, 7B, the operating room indues , on e 
visible walls, an operating tabic in the middle of the room, and equipment. Also visible 
s < v > * j Sueopor.tnj \i- ch !y ,,Ou ode* ,k 

* s ,s ' <■ ting room garb called scrubs [ see persons 

are dressed m green scrubs 78 la, 781b, 781c, Three persons are dressed in pink scrubs 
" v 3 A7c. AH persons are « vo.nl 
g tabk ere d in white cloths 

84a, ?84b the detail visibk in view 780 exceeds what h> needed ft determine that the 
* i in ^ w isiosi of the pi *acj dx e s ? pe sonnet 

[0I05f In step 730 a canoes image view 790 is derived based on the .raw detailed 
« s N . s > s. < si Ac- a ;ess 

' ' i N < ! In the 

cartoon v;ew 700 certain objects visible in the detailed view 780 and considered sensitive 

« s > s it representee by solid colored sh 
in green sen ?8ia Sib 8;c arc 5 ese ted s 0 > green shapes ?9ia ?<>l.b ?9!c 
-26- 



WO S8ft5f«33832 



Docket Namta UMB001 -004 
vs^u-o-; 

v v r ih ee perse? o e ^ x ^ 

as solid piuk shapes 792a, ?92b. 792c, respectively. The blue hair net 783 is represented 
« s< v >!etshapj 793 Ph * te cloths 784a 84b are appa s % tie shapes 

^ v. «. \ V S i„m J I <. , S t ^ Shi 

, ! Mi ' U 1 r !>M 

< ! - > o am; other J \ \ ^ features ate e, n t ,,l .v k the earax;r; m g i v> are 



code is 

shade* •: 



and satur? 



is green sc rub* ha v<. , 

i v x jl! m< * k > G4 

is omitted. For example, in same embodiments, cartooamg Is done or RGB coded pixels, 
hi some embedsnienis, . raw image data is received hi HS V coded analog or digital 

HSV coded pixel;;, hi some embodiments, step 730 indices d;gkmmg aoaiog HSV 
valises to RGB coded pixels. 

\mmi In step 736, ranges of coded values that represent sensitive objects are mapped 
so 3 single color for the solid filled shapes. For example, in some embodiments, ranges of 
) t>v ^ s Ui i , i, > , - s, 

- 1 i c a patticuSat value and a ;> h 

(a particular RGB set of values j. Similarly, ranges of hue and saturation values associated 

s 10 «1 K v Of 

a single cok (sw as green, violet and white) 
fO I.Mf la some embodiments using RGB codes, ranges of red, green and blue values 
-„>i>iare maprxv < 
green value and a par < j 

oi , green and bine values m pixels associated with various < sensitive objects 
s as gmen scrubs, blue hair iieis and white table cloths; are mapped to corresponding 



-27- 



•WO 2M&ti»32 



i>>cketNii;n^:'UMBO0i--O0^ 
YX20G4-012 

single colors (such as green, violet and white). m some embodiments mis o , p. * is 
retrieved from computer storage based on ranges and solid colors predetermined by 
aisidysis examining sample images. In some embodiments this mapping is retrieved h< 
computer storage based or; ranees tract solid colors ^x by image processing of 

sample nnages, in some embodiments this 1 p 1 is performed s x % and 
- 0 < ' i i\ - 

\Qi In s t 738, a cartoon mex image ;s generated by cornbmmg the sedtd < » n 

> d "> s » i v Si \ ( k \ i 

image ;s a. blank {'black) image. In some embodiments, the base image ss the original high 
m-um-o image, so s the sensitive objects are replaced by cartoons mode other less 

i s ■> , f m t,<, nsk\.n 

view. 

|0» Ij !« the (iterated embodiment, the single cartoon image depicted m black and 
sequence of earioon views dsn ved bom a sequence of images in a video clip provide a 

^ f ' s v. ! 1 i X Hi 

operating iabie in an operating mmm 

*fo-i ^ s m\i:ii pe <. ss t u < kfo 

have low j: i! s j$ been n ore 

mas m >, ', - \ \ gi oi nurse Wft^ a x * ! 

;ard made? 0 ) 

|0iJ3j \ xet 'i xtcari >n view image is presented to the parties coordinating the 
nse of the operating rooms. For example, the system 400 does not display the foil detail 

it ^IC a M0:>, or 510c oi the inter ^ce 500 b v v rU on 

views as image data 510a, 510b, or 510c of the interface 500, 



folMj s v j ra t 0 , )( e t ion «00 

n % s .c^idmg to an embodiment. Method S00 is an 

"X. S i v, „ s ». ' > ! i ,< si , \ m ' I > ^ IvH'Hjl 

101 15| ! ^ 1 i i , Ml t< 

from XjUs stgx > mom < x - ! m n xe m ^ il ^hen, 
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! uses Ge; er 



e-work. 



v > , , v 

of the GE vital signs monitors and GE data reporting r. 
embodiment, none of the patient identification information is used or displayed, except 
for a patient or case number. 

|0J U\ in st< n 830 is blab; [ n data ndieati )g patient s? itus i;f or "out" is generated 

^ 1 ^ t«« s v one operating room, in some embodiments, a 

vitakigns status ofV or "off corresponding to a patient status "iff or "out," 
.respectively, is used. In some embodiments, ihe future availability is omitted. For 
example a patient states parameter is filled with a value indicating "m" or a value 
HKhcabtig "out," e.g., mmhtepatientStatus = i for "in" and patieniStatus « 0 far "cut." 
Step 830 includes steps 832, 834, 840, 860, 862, 864, 866, 868. 
lOIH] In st ep 832, real time vital signs data collected from the network is fed into en 
array that represents a moving temporal window. Any method may be used to fill she 
artsy with the vital Signs data. 

mm Tn step 834, text strings in the vital signs data are used to determine values of it 
set of vital signs parameters, called a record of vital signs, including values tor the 

* J ue{HkATe}der-vedbvrhc on tor from data alon live 
w " V " S ^V »<3oK\};en duration (02SAT), non- invasive blood 

pressure (NBP) and body temperature (TEMP). Multiple records of values for these 
parameters are included in the moving temporal window. For example, for purposes of 
illustration « >s assumed that the moving temporal window is five minutes long and a 
record ss obtained every 10 seconds, so there are 30 records included in the moving 



ve paoent status ss determined eased on the data in the 
m ana ?- FIG - 8B ' s 3 fl ow diagram that illustrates a method detail for step 
aldy coordination method of FIG. \ according to an embodiment. Control 
842 from step 834. 
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< ; n d i < «*c.y^n 

card is in -Mk raag« T N es impk t sdete mined t e hea HRATE value 
is sha?-A a minimum heart rate of a liv ing person > less ilia;) rnaxinmm heart rate 

of a l iving person. 

f012tf if it is, determined that She electrocardiogram data is m a valid range, titer! t is 
determined that the current record indicates that a patient is "in" and control passes to 
step c$6, if d is determined thai the electrocardiogram acta is not m a valid range, then 
» , >\ v ♦ - V etau; from the other monitors to determine whether she 

n 1 is "in." This is done because the i o might < yet be hooked to the 

{0122] to step 84 as. c o n.u'Io d<fd f o£ 's n,;, m < mi ho k 
v ibetroste< t'nc determin dors of >a em »tus wii? be based < 
ammtors. For example, in the QE vital signs data reporting svstenu when She oxygen 
saturation sensor is producing suspicions or sporadic readme:;;, the TEMP value Is 
reported before the 02 SAT value. Scans suspicions readings may be m a valid range for 
d oxygen sah > ent. In s refote., the 

oxygen saturation sensor <s no: considered irustubte if the TEMP vaiue precedes the 
02SA val the dai s 1 )2SA ilue is also i 

> lit','''! K \T x > !^ v , v w 

nu inn Ik a k i te for in e <t period 

i 5 - I v f ii' )i M'driiPt !Cp 

- v eontru passe to -s4t s , srewhetLcj 

O- > i, — »> t - > , )j « j « 

10123] In step 846, it is determined whether the 02SA.T value is in range for a living 
* ^ deb jo s iou«he02SAT value is within the range from about 

> > thftii! determined tl > >che<:ie that 

t i ; step 856 If ft >2SAT val c v.sram 

or if it is determined m step Sad thai the 02S.AT value is not trust f t o passes to 
step 848 to cheek , TEMP 

\M24] step 8a 8 pes The 

TByp value ss also not trusted drthe states based on the TEMP values disagrees with the 
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previous status, if it is determined in step 848 that the TEMP value is tmstabk, then 

S , \ , ^ v C v , 1 ^ ^ v i t M 

|0125| I p 85? is ed whet the TEMP vara 

i<n.;v\:'i.-; Irs « n , - * - e, \ - -s the G£ ni sig-os i > w - provide two body 

1"< s ! v, S ! >R v lb 

whether enhe " or TEMP2 value is above some minimum teroperahrre. > 

some erob > * s > ! * 

minm-urn temperature for passing TKMP2. 11' cither temperature value is above she 
approprsate nmmmum the-; it o; detersmned thai the CLum-mi record indicates Past a patient 
\ v see > . ^ >s 'tor ! Mi * i k npropriate 

t ^ i t x s t : i 1 5 < 

passes to step B52 to check the NBP data 

{0126! & step 852 it is determined whether a noninvasive blood pressor {NBP} 
i i >msentrtr^ 

v fc g on 

■he order of every id minutes). Therefore, ;n this example., if no blood pressure has tx-en 
taken m the last 10 romutes. then it is determined that a patient is not 'in " If a blood 
pressure measurement has been Taken t i i the specified <m then it is determined thai 

> ^ 1 a, . f ten 856 

Wi l7\ •> " s stos for the record is set to i and control p ss to 

step 857. in step 857, it is determined whether ali the r&.o > ! ^ \ > > 

^ ~ v v. S > , S' I y^s \ s \ S- 

[0128] fc step 858. a variable is set to hoi caie a ©t lath, 

> 5 ! , > S k S £ i " } . , 0 t FiG 8-1 

101291 J 5- ^ it sF'i! i , , , . ■ 

« s tea 857 that not ail the recoti t t erwpora 

of To fhei control passes to step 839. It; step 8.59, a 

s i ii V<U um vvmdow 

v nethod bOOof "PIG. 8.A. 
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{8330] In step U t edwhct the va 

temporal wmdove is she n as the previous value stored m the parameter variable 
p<U;emStaais. If so, there is so change to the status and control passes to step 862, 
fllBf i In step 362, the server waits for the next signal from the vitol signs monitor. 
Contn ' p ^ » b ic\ - step 8 \ to feed \ ; xm ngna! ir to the ox* ng wsado* 
101321 If h Is determined in step 860 thai the value of the variable .for the moving 

; px <■ >! v «. d 

pztUw!Stim<< control passe*; to step 864 to respond to toe change. 



penod of time before the present time, then control passes to step 866. In step 866, the 
change is considered a false alarm beeause patient status should remain cotxtrant tor at 
least the specified period of time. Control then passes so step 862 to wail for the next 
signal ho;;-! the vita; ssgn.s monitoring equipment. 

10134) if it is determined in step 864 that the previous value was constant for the 
p< itx od ftmx then control passes step 868 In ste 8 i 
p. n.s ^ m < < 

' ' m < , > ~,t s sc ! jo the present time. 

I> ^ ^ v , emoted time for the sex! event is also 

8 m 1 si > u j i nt 

^ 1 t i )i )oopudtm« abv. ^ ds »v 

\umenl-5 s 

predicted time is not deteimlned. 

|fH36i s n r» 0? p 

" I Id tor OR 1. In some embodiments, step 870 
- 5 * j t t „ whtcboud 

s s t-, >R 

P37] FIG. 9 ts a Oovv diagram ;>sat illustrates a facility coordination method 900 
"> - i t » 1 > > e , j i , 
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Method 900 is an embodiment of method 200 m which step 210 includes step 910, step 
230 includes step 930, and step 270 includes step 970. 

|0B8: to step 910, facility oomlmons data s produced norr intrusively by detecting 
electromagnetic or vibration emissions > equipment in the operating room. This > 
accomplished using an emission detector as a sensor 310 in system 300 depmted re FiG. 

s i' i - s «. v 1 ' ^ k 
> ! t\ I i£ <J r i r 

w ^ each coot ^ v - ^ g >m waves wdh a peak amplitude sommvhere \ the 
frequency range from about 350 to about 800 fciloHerfcz (kHz, i kHz « 10* cycles per 
. d v v v , f sso e <>! ; s 

etecte< < det V. ethod s >e user i eoni 

s v juiiit ng mphmde modkation (AM) radio t 
recorders for emission m the xaage from 540 to 800 kHz. In some em bods ats 

1v <U -igi v i ! t \ t 

The detecting and recording or eiecironiagnenc emission is an advantage because step 
910 does not mteriem with or cr '? any >') o< i the t m s of the- Bovie. ktnre 
models. 

In step 930, availability data indicating incision status as "pre-kcisioxt" or 
''post-kdsiom is generated along vuh Puma availability for at least one operaksg nxmr 
' ! < ( ! iv > rns v is o s t ou T >r cx » p s -nit-, , , 

- > - < 'Mp po-t- 

inclsioo,' ? e.g., variable t s s , ^ p f cr p t - s » and mr^vm/oSkms - 1 V 
vs )}2,«V 960 and %S. 
- Cision status paraoacter is set 

\ i \t s v !Cv^ <. t , heo'fk h si s s i <. „ui Jh d 
\i«'cs from 'ott ' to r ■> u , 1 

parameter. 

|0I4J| ^ n w . i <■ , striissio , ' 

red > > a tcuiporal window array. 

10142] s htthcr me jpect x 

■> s x. s p , *x s r s* o 

emhodimeng a Bovie knife operation is detected if a spectral peak exceeding certain 
~33-< 
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x ^ <- K iff <- "h ~ , f U\ V " v - v h < 

- i. < ft i , I v S X X 

dnsvoph routine experiniemafson J;s an illustrated embodiment she Bovie unit works n; a 
pre specified radio frequency. 3y foci.ssrrsg on the known .frequency nmge she effects of 

f J (i i v t < u ^ 

In some embodiments, kmfe operation signatures must persist for a specified period of 
erne, such as one minute, so qurjHfy as a reliable demotion. 
siHs^s < 

> x k I to feed Use next :mak;sne signals 

movdig temporal s^-ando-v array. If e is determined m siep 960 that dee signature of Bovie 
knife operation is detected, control passes to step 968, 
I - the parameter v,"t 



predicoon oiher stages can. also be predicts;. For example, a time can be predicted when 
v n » » ' o i. >,n K 

i idy for she t \ en ! v jfaodiments a 

s >- determined. 

whiteboard .102 or both For example, in an illustrated en wtsioit status 

value is projected onto whiteboard 102 its progress data, e.g., m progress data 5 i 2s for 
OR 1 v . ' v s •> •> nx V 

- 1 ( s „ lor me th, o^ v 

s v. s ! xx nb i > n S t u U < 

n , * » iORI 



; 0I4?1 

projected onto svhkeboatd 102, may be presented n any form. Progress is often repotted 
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« h a progress has i ei »r reprei - ! 

\ S tv\. S !v , 

ia she progress data. 

{014S| FIG. I OA, FIG. LOB and FIG. 10c are a block .ua^aw 0\i : ts- * " ! ^ 
■ \ i a w>l\f avOi.iUiU^.r .rboum 

1000 includes a planned bar 1010 and an actual progress bar 1020. The placed bar 

; a Gi4 

r'ocetua- De\ >o 

planned Start mrse 10 12. The actual progress bar ends at the late:;,; s:ea«d progress time 



1 JG >0\ \ - ' i < s • 

are t tune for s p v. s . ty and >s the act al ;£op tin ? for 

prciccdire thai *as * ?he« Xevia >\n from the planned use is displayed by an actual 

« . *V H'O r J' ! f_ 5 SK S Kl . > \' !l v < ■> OS 

and a iaisat actual progress time 1044 thai does < align with she planned •> time 1014. 

as oegins 

at 0% and ends at or beibxc 100%, v deviation displays 1000, )030 include an actual 

s f v v G ! n Mi >tw \ iu,n--jrh 

planned use. 

1©151| I e < displays 100 M the eti ! ^r es ^ 1 2"> 1040 are 
- 1 w hir 1 0H>. Inothe^e > 

-egress bar. 

[0152! in FIG. 10C, a deviation display 1060 includes the planned bar 1010 and an 
actual progress bar 1070 that are the same width. For comparison purposes, planned bar 
1010 and the acres! progress bar 1070 have the same start and stop times as planned bar 
v \ s 1 >. < iv. ! - T\ actual 
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progress, bar 1070 begins at the actual start time 1042 and ends at the latest actual 

! < ! i i ,i< 

0153 viatioa is iadt Son shadit us sc 

- - ! - si , llt 

1070 th< splay has one color shading type. Wberx « 
actual progress bar K)/0 overlap in section 1070a, the actual progress is within the plan 
5 ! s s iti.it g type, Where the aeti t oes n< 

overlap the planned progress bar KH0 in section 1070b, the actual progress extends 

i 0 ^ < ^ S (. w s , ^ 

<ltHere.it colors or shading is used for actual progress that occurs before the planned start 

S ,. M! <! ! S '< f! ! j 

example, m an embodiment a green color is used to indicate an early start and a red color 
is used to indicate a late finish. 

[01541 in any of the deviation displays 1000, 1030, 1060, the length of the planned 
bar may be fixed and the actual progress may extend as far outside the plumed bar 1010 
as needed to indicate actual progress. In some embodiments, the extent outside the 
planned bar is presented on logarithmic or other non- linear scale to prevent the display 
from becoming too big. In some embodiments, the actual progress bar is allowed !o 
extend only to a predefined maximum length. For example, the maximum length is 
m< red lo * .11 a a progress date nea 5 1 ? of a projection on a whiteboa d In such 
embodiments, as the actual progress continues m time, the pfenoed hat is „ duped in 
length proportionately to demonstrate the difference between the actual and planned use. 
V desct bt x i >me em >diments tin ei ler or both bars, of portions of bars, i 
the display ate plotted on a logarithmic or not> linear scale. 

e v ^ \ 

#1*1 HO. 1 1 is a block diagram that illustrates a computer system 1 ] 00 upon which 
an embodiment of the invention may be implemented. Computer system 1 100 includes a 
communication mechanism such as a fo;s 1110 for pmS m Z information between other 
internal and external components of the computer system 1100. Information is 
represented as physical signals of a measurable phenomenon, typically electric voltages, 
but including, in other embodiments, such phenomena as magnetic, electromagnetic, 
-36- 



wo zmtmm 



Docket Number UMBC si-004 
YX2004-OI2 

pressure, chemical, molecular atomic and quantum interactions. Fes- example, north and 
youth magnetic fields, or a zero arid non-zero electee voltage, represent two stales (0, .1} 

v, . ,\\ ) s < is < - s . 

represent a number or code for a character, A bus 1 1 10 includes many parallel 

V ^ t ' , U, O I s>-\ v O < iv v . v s,^ 

wipcvv vm,.teo i esv , i „ ^ xs ! 

coupled with the bus I ] 10. A processor 1 102 performs a set of operations on 

s cladt bung m ini >rmatiot 
- i u;mg ss Ibnro it or, on :V bus 11 10 {'he set of sex uk ns dso t - 
comparing tsvo or < units of information, shilling positions of costs ' m s n 

v 0 ! ^ J ^ V 0 - x s ' t , , :\ 

sequence of operations :o be executed by the processor 1 102 constitute computer 
instructions. 

jOJ S6J Computer system 1 1 00 also include 
Toe memory 1 194, such as a random access ro- 
ds \ t ^ -k , (V i ; i 

> <■ t gtd by the 

> * » •» v a a 1 xa.on called a memory address to be stored and retrieved 

1 X(,<t ' ! he ' a-s o s 71k neu.es <>4 s also t -ec by 

< N ■! mr> v,daes dumgosx, s ; s ( ^ c tn.icti.ios 
The computer system 1 100 also includes a read oasly memory (ROM) 1 106 or other static 
storage device coupled to the bus 1.11.0 for storing static information, including 
instructions, thai is not changed by the computer system 1 100. Also coupled to bus 1110 
■■ , uo:,--l s m >— s< > ^ ,r 0 '*g. device 1 108, such as a .magnetic disk or optical disk, 

s u j v x i o computer 

" ! ~ - ' 1 ' >s. power. 

(8157] Information, including instructions, is provided to the bus 1110 for use by- the 
- - i, nouee ,112, such ss h k ammg 

s peu ted 0) s hu ran user, ox a sensor. A sensor detects conditions in 
" N - N N " i ~ «.c*Jotj» mm signals compatible with the signals used 
* ~ N « «■ > * ' -- h.v s sv'ii 1100; Other external devices coupled to bus 
n i ^ , , . ! * vtchas 

-37- 
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nstrucuons. Dynamic memory allows 
computer system 1 100. RAM allows a 
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a cathode ray tube (CR T) or a liquid crystal display (LCD), for presenting images, aid a 
poiming device 111% such as a mouse or a trackball or cursor direction keys, fot 
controlling a position of a small cursor image presented oa the display I i 14 and issuing 
commands associated v/ira graphical elements presented on the display 1 1 14. 
i)m *t ted, >«dh e t spec u ,q s< < V8H JC 1 as a 

^ * u' v d , ; , t , , , i2 

quickly enough for special purposes. Examples of application specific ICs include 

s accciemtor cards erat < 1 ; 4, cryptograph 

for encrypting and decrypting messages sent over a network, speech recognition, and 
interfaces to special mexml dex ices su < h as robonc arms and medioa scanning 

taipmen i repeatedly pe >n ome complex sequent of operations tot afe more 
efficiently implemented in hardware. 

m m Computer system 1 J 00 also includes one or more instances of a 
communications interface 1170 coupled to bus I HO. Communication interface 1 170 
nm dcs , two w a> commt n canon soupJi tg to a vai ety of external devices thai operate 
with their own processors, such as printers, scanners and externa! disks. In - v , J 
coupling is with a network imk ] 1 78 that m connected to a local network. 1 m to winch a 
variety of external devices with their own processor are connected. For example. 

l£rface 1 N « < ^ielpo o i sun pc to, u iversal seria 

bus (USB) port on a persona! computer. In some embodiments, communications 

K ^ ' k <-d setvue,-> di^mJ > c uorK ISDN i card o agmd sub her 
'me (DSL) card or a telephone modem dial provides an information communication 
' m to a corresponding type of telephone line, in some embodiments, a 
[cation mte.rfa.ee .1 170 is a cable modem tot converts signals on bus 1 \ 10 into 
!! n 5 * " val^o u ovohk yna s <t< 

on con ect oi ove i fibe sptk cab e \, « other exa q k 

^ "A.,,--,! lH J«ta 

" ^ ^ ^e. \\ su ,f* ,X !Kt ^s, t \s vo 

f l! ^> ^ communications interface 1 170 sends and 

receives electrical, acoustic or electromagnetic signals, including infrared and optical 
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carrier waves. 

ii The term computer-readable medium is used herein te refer to any medium 
l e e - t v.N - i ^ \ < ,) m>^0 i 
medium nmy take many .forms, including, but not limited to, non-volatile media, volatile 
media and transmission media. Non- voianle media include, for example, optical ox 
magnetic disks, such as. storage device i 108, Volatile media include, for example, 
dynamic memory i HR Transmission media include, for example, coaxial cables., copper 
- fiber opt;e cables, and . s travel dirongh space without wees or cables, such 

,s mU *K \s,1xCn k d , ' > 

>» M > - 0!, , v. • . 

181 6 1 ] Common forms of computer-readable media include, for example, & floppy 

compact disk ROM (CD-ROM), or any other optical medium, punch cards, paper tape, or 
any other physical medium with patients of holes, a RAM, a programmable ROM 
(PROM), an erasable FROM (EPROM), a FLASH.- EPROM, or any other memory chip or 
cartridge, a carrier wave, or any other medium from which a computer can read. 
|oi62| Network: link 1 i?g. typically provides information communication through one 
or more networks to other devices that use or process the iofommbon. For exampfo 
network link 1.178 may provide a connection through local network 1 180 to a host 
computer 1 1 82 or to equipment 1 1 84 operated by an Internet Service Provider (iSR). ISP 
equipment 11 84 in fort; provides data communication services through the public, world- 
wide packet-switching communication network of networks now commonly referred te as 
the internet 1 190. A computer called a server 1 192 connected to the Internet provides a 
service in response to information received over the internet. For example, server i 192 

-> m , so-n iced ei io-ptv-e , > i i 
l«163| The invention is related to the use of computer system 1 100 for implementing 
f c de ding to one emhodune te luvemfoi ins 

techniques sre performed by computer system 1 100 in response to processor 1102 
execuimg one or more sequences of one or more instructions contained in memory i 104, 
vdsoftvwe x' program code my be d -A memory 11 04 
i such as storage device n of the 
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sequels of instructions coTstained in memory i 104 causes processor 1 102 to perform 
She oiaitaxi s described herein in alternative embodiments, hardware, such as 
application specific integrated circuit ) 120, may be used m place of or m combination 
with software to implement the invention. Thus, v> > n- 's or ihe invention a:'e not 



limited to ; 


any specific combination of hardware and software. 






[0164] 


~hc smo,n\ i , 

it sons > storf, e »formatt« 


>thej 
fror 


no;.- s ocp: 
n - >osp,m system 


li 00, ares 


x; m.an u < e Computer system 


HOC 


1 can send and receive 




n, including program code, through the networks i W 






^ i.i 


90 among other:;, 




ivsork hok 1 1 '? B aud .communications interface i 170. 


la { 


sn example using the 




90, a server 1 192 transmits program code for a partic 
?y a message sent from computer i 100, through Inter! 
. network i ISO and communications interface !]?(). ' 




application. 




set I 
Hie 


190, ISP equipment 
received code may be 




y processor 3 102 as it is received, or may be stored w 






other nom? 


mlarile storage for later execution, or both. In this mi 






1 .100 may; 


rsbiain application program code in the form of a cam 







101651 'Various forms of computer readable media may he involved in carrying one or 

tri =i h o wes^o [ t.2 k execution T o! 
example, bstructions and data may initially be carried on a magnetic disk of a remote 

st - N r: v')r;: >mr. «e Ks-t 1 , 
v ! ^ x < Rtmns and data ova .1 < t;s j 

modem. A modem local to the computer system. 1 100 receives the instructions and date 
- * s > m > v a s t i t } , 

ait infra-red signal, a carrier wave serving as the network link 1 178. An infrared detector 
serving as compurgations interface 1 170 receives ihe instructions and data carried in the 

' ° f v,m<- 1 c Jo v v , ^n.xnts 

i 1 ;0. Bus 1 HO carries the information to memory 1104 from which processor 1 102 
1 -> » v , -mu * t v, <v,s uMog som, 1 ,j t W! , t t o nstruc sons 
- ' v vved in memory 1 104 may optionally be stored on storage 

1 < , i er es i f p x > i 

x - - -i It will, however, b v . c- t >• m, , m <. s 

-40. 
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CLAIMS 

VI ha! s la is 

2 method comprising the steps of: 

3 i >s ,!",. v !< , ! 

4 coadiiiott of a facility for which use is coordinated among a plurality of 

5 human parties; 

6 ndicates avadahhtv < 
'? {ions, data; an< 

8 ' <» ^ > u ik . n i at least in part on the 

9 availability data. 

1 2. The method as recited in Claim 2, wherein; 

2 i V ! I ! 1 ( 

3 room, emergency room su'tosa'xi a vajdu.-: -v\ > . , 

4 1 > ,x - i j t ■, n v i < 

5 technicians and orderlies. 

1 3. The method as recited in Claim 1, wherem the facility is an aircraft and the 

2 'hfth;\o< -■ i ! ,i ^ - c>'!on persojmel including a mechanic, a baggage- 

3 handier, a caterer, cleaning crew member and a flight crew member. 

i 4. The method as recited in Claim i , wherein the facility is a collection of 

3 response workers. 
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; i I., whereis 

2 v s s 

3 A s . «y the c^^rdiEiuhon data <t? a p3rticu?&i 

4 time^ and 

5 deierrnmmg a particular v of privilege among a p!«-aH;-y of levels of 

6 s - 

7 ' . ^ aslabdm data fait,'. . s, >. -u ^ i 
S _ , i.' 

9 ' i S f v v v S. 

10 sensitive date: and 

*J said step o - s. - mat ion data forther co > sc t 

5 2 particular view of Use plurality of views based on the particular of 



t step of preseming the facility coordination data further comprises omitting 
view with a high level of detail of the sensitive data. 

7 *> * »s uw od »i(ki 1 sa,d s cp o* g, „ < t t , c 

comprising the step of generating a value for a particular availability parameter and an 
estimate cook h< u of tlx > c ivaikhiiit parametes 

8. v v -d j nt, as a ah I h d ! v 

M -o-et-r. v < , „ v , s t>ased &i least in past on the conditions data. 

9. i'he method as recited ;n Claim 1 , said stet of nodt j ng t otid.it on d ua further 

— " > <! , J,i O . . !t v > 

H). v v , % -m ; 
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2 camp- 

1 a. 

2 eornpr 
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Qat3 a cartiXm View «»»pri»ng a solid filled shape to represent a feature 
apparent in the image data; and 

s>ttK! step or p! ' eseriiin * * e coordination data farther comprises presenting rise 

The method as recited in Claim 9, said step of generating availability data farther 
S ' Iig dedvhig to the ima § € da?a 3 status value of a plurality of status values. 



an empty status value that indicates an operating room 

not prepared for a new occupant; 
a ready status value that indicates the operating room Is 

prepared for new occupant; 
a drapes -off status value that indicates the operating roc 
rne occupant is not: covered with a surgical draw 
a draper status value that indicates the operating rot* 
sne occupant -s covered with a surgical drape. 



v v. ! < i\ < 



i collecting equipment operation data that indicates operation Of equipment 
the facility. 



I .14 



Ihe mcood as recited in Claim 13, said step of generating Ability data r yrther 
' ' W< ^ — t nected to aheart ;rt ouitorbyp e rforuu,g 

signal processing on an output from the heart monitor. 

s s? nit * w 

'j. fa n . ht e<,,« .v. -cut operation data a status value of a plurality of 
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I 1 S v f " 1 i > \ 

3 a vbaisogos-oiTsenus varas ' f < <. \ patierii 1 signs are not iie!:<u-isd by a 

4 vasal sagas ;r;orntor; 

5 ' (. s p l S v 

6 I , - , - ri 

7 a pre- incision saams value > U k a Huxgeon has not starred an incision -. 

8 ^ < 

9 n s < i x H \ s s v !> 

10 electric tool. 



17. V. X- . ^ l\ < ! > , A 

! | q .smart t-o t.to i t < „ s - 

^ v t o . of the equipment and svnhom modifying commiisocaii;ms with she 
equipment 

Itf i s ' ..rf la m i?, a< si 

data further comprising capmrmg network data traffic from the equipment 

1 \ v .tT r md ' ep o\ 

data mrmes comprising measuring a; ieass one of eketromagrsef.ic radiation from -he 
equipment and vibration isolation from the equipment. 



1 - - ?, said step of colkc 

2 «t uprising collet og vil< signs data from at least one of a he^nmomtorand 

3 a blood oxygen monitor. 

2 dan ,s v yds eas e m < ttion from a Stovk scalpel 
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4 ( >K t ' iata %;ilv' composes pu 

5 display element that indicates a deviiidon from the planned s 

1 23. The method s recited In Claim 22, said so of presenting a display element 

2 , i ^ f sMthe£ (.o'ipnM-u: t&e o t. s " < 

3 i \ \ ! i % ! ->s n t 

4 overlaps and extends beyond a second bar thai indicates bine for she planned m;e. 

1 24. The method as recited in Claim 1„. said step of presenting die coordination data 

2 tmtm < , ^ t ; , s., a xl ,yi tk. n 

3 men - ss v »■ ;he facility 

1 25. lbs method as reeded in CI a 24, said step of presenting die coordination data 

2 h > \ i s 

3 <isteeting user spat ' pmsentahon of the coordination d no ihe tangible 

4 system; ami 

5 presenting display demerits of she coordination data based on die user input. 

' - < 1 d recited in Claim 25, wherein the user input comprises a manually 

I 27. he m I v wherein, the manually moveable token on she 

4 ' U > , k„* state. 

1 28. The method as recited in Claim 24 wherein: 

2 of ipu o oil j no 

3 f i lily data further co p e <l t ng availability 

4 database 

1 1 1 s ^ ' s , i < fI i 

2 s > moveable token on the tangible system. 



-4e~ 



WO 2885/033832 



x:kcr N h s 

YX2004-012 

2 > v v ^ u. n whev 

3 human writing - allowed, 

1 w v; :i- ; ^ i octfo m no;e\ w v - ndorn.imr vO^pns'Kg 

2 the steps of: 

3 capturing an original image; 

4 fering on the image to produce a low n 

5 mapping s «, > {ur 

b )fl Ok 

7 generating a low detail image with pixels of the first single color si each pixel 

8 location where a color of a pixel from the los - »s < 
§ the first range of colors. 

| 32. \ , ^ 

2 steps of: 

3 presenting a first bar that indicates time for planned use of a facility; and 

4 prc-o-muu. , «. h.s for ? _d time of actual use .\ { s t o iXutv wjKnnn 

5 second bar extends at least in part outside the first bar. 

1 33. A method for inputting data to a computer connected to a video input comprising 

2 the steps of: 

3 capturing a video image of a two dimensional surface including a manually 

4 ^ nHe to en wlna n n <. st ^m \ < „ ^ j 

5 hie token indicates one stale of a ty of states 

6 greater than two states; and 

7 determining a particular state of the plurality of states based on the video image. 
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v e% c> s ~ . a i ^ . ^ ^ * o t\ i \ 

! i ; 1 at humai % >ti a cum» 

condition of a facility tor which use s coordinated among a plurality of 

v Kim i ^ - m of the facshn, and 
wtki i « > i i r v 

utilized in die facility without rnoduying operation of the 
equipment and without modifying coouysnmeations with 
equipment, 

v ^ « 1 >p« arfng t >oro t 

surgnaloperatn^n , s t x t „ , ^ 

d then -si, es include a plurals of ! ti i doctors 
nurses, medical technicians and orderlies; 
««* 8 - v- > that indicates a ianned use for the facility; 
i i i at < nit s i s ; 

in pan on {he conditions data, including 
generating sensitive data, 

generating a pl urality of views with diffe rent levels of detail of the 

view comprising a solid filled shape to represent a feature apparent 
in the image data, 
deriving from the image data a status value oi 



■ data a 



* ' ptudic j- <i l.v time for a particular subsequent stage of a 

28 s i > N v • t\ > a t eda par; or- the 

29 conditions date; and 

30 determining a party who has access to coordination data at a particular time; 

31 determining a panicaiar level of privilege among a plurality of levels of privilege 

32 based - t th parn and 
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33 
34 

35 v. » ! ' 1 v v s 

36 ; i ! ss v i 

3" of privilege, 

38 . n , 

39 mid 

40 presen t t j c s. 

41 the sequence of stages for using the facility. 

35 A system tor delivering data for coordinating multiple > use of a facility, 

2 comprising: 

3 a sensor for producing conditions data thai indicates without human intervention 

4 uUy that -s used fo s > 

5 a display suriee for accepting as least one of human writing and a tangible token 

6 manually positioned by at least one party of the phnahiy of human parties; 

7 r <. i rfaee 

8 at least ons p.t seessor; and 

9 more sequences of instrut 

W wherein execution of the one or more sequ< 0; S tra i< >y the 

l * processor causes the at least one processor to perform the steps of 

1 ? - - v , w f;om the sensor, 

13 acncuhr ... 

* 4 af least in pari on the conditions data, and 

iS sending to the projector coordination data based at least fo part on the 

^ availability data. 
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1 36. The system as recited in Claim 35, wherein: 

2 * 1 i video « < v < ? , j 

3 capturing a coordination board image of at least one of the human writing 

4 and rise tangible token; 

5 execution of the one or more sequences of instructions by the at least one 

• Pressor causes the at least one processor to further perform the step of 

7 deteradnrng input data from at least one party of the plurality of parties 

^ . <>■ ths coordination hoard image; and 
said ste» of sending to the projector coordination data is further based at least in 
past on die input data. 

1 TL Tb " ^stem as recited in Claim 36, wherein: 

2 the system furtfier comprises 

3 a communication link So a remote site, and 

4 ;i remote display device at the remote site for displace a remote dis -<lv< 

5 image; and 

h execution of the one or more sequences of instructions by the at lest s 

processor causes the at least one processor to further perform the steps of 

forming the remote display image based at least m par; on the coordination 

board image md the coordination data, and 

I : " Seadin 8 fc ™ <%*ay image to the remote display device over the 

11 



30 
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tangible token manually positioned by a; leas; one party of She plurality of 

- : di ad >nto ih< dssp aj udac 1 

* ^ \, ii > , eta 

means jot generating availability data that indicates availability for the faoiidy 
based at least in part on the conditions data; and 

O V. x v > - 3S v ON 

insting multiple party use of a facility, wherein execution of the one or more 

ices of instructions by one or more processor causes the one or more processors to 



conditions data indicates current condition of a facility that is used by a 
.plurality of human, parties; 
generamm avanabibiy data < indicates availabiiitv for she faellirv base;; a least 
s data; and 

mimad d " based at least m part on the 

availability data. 

The computer- readable medium as recited in Claim 39, wherein: 
* ^-oiv i i tote >pu t n L 

^ laboratory, met 

the plurality of parties m ude a phiraitly- of medical doeio . i % medjea 
technicians and orderlies. 
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Y> * ^ 

S t ^ v ^ X 1 

2 tureraff and the plurality of panics i k aircraft preparation n v ^ including a 

1 42. flu; com^utet-osadabk medium as recited in Claim 39, svherein she facility rs a 

2 ^ <- l 1 -■ I t v ! ■> < v 1 j j < t 

3 % s' . V s 

1 43. Hie computer-readable medium as recited m Claim 39, wbereia; 

2 \ v v )i l v v is i \ 

3 more processors to perform the steps of 

4 determining a party who .has access to the coordinates data at a particular 

5 time, and 

6 determining a particular level of privilege among a plurality of levels of 
"? privilege based on the party; 

S l , ; o, „ s , j,,i v m s 

9 fo , , v s's! c o o and 

10 <■ v of vse%vs writ diPer si W ^ , 

ft seosihvedul i 

12 said step of presenting the facility coordination data fur&e? comprises omitting a 

1:5 parot dar \ eo of t k plural tv of ^ level o! 

14 privilege. 

1 44. The computer-readable medium as recited in Claim 43, wherein: 

2 said step of determining a party who has access further comprises not detecting 

3 input from a party with a high level of privilege within a particular lime 

4 intetvai; and 

;> i i i* s ! r Nfmit no < 

6 < < det il of e sensu e d la 
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i - * > „ 

45. The computer-readable medium as recited in Claim 39, v step > v s u 

s ie step of generating 
availability parameter and an estimate of accuracy fox the value of the particular 
availability parameter. 

46. The computer- readable medium as recited it; Claim 39, said step of generating 
ivaiiabifcty data furthers >ris s ep fpredk parttcuh So «s ! o 5 fo 5 

s s 1 to sequent of stages for using fh< 

part oft the conditions data. 

47. The computer-readable medium as recited in Claim 39, said step of producing 
conditions data runher comprising collecting image data depicting at least a portion of the 



3 v 1 1 > - mo ml in C iaira %1, wherein: 

2 satd step oi generating availability data former comprises deriving from the image 

data a ca-toon.view comprising a solid filled shape to r t ,<< mi 

4 s , 

sam step of presenting the coordination data farther comprises presenting the 
6 cartoon view instead of the image data. 

1 49. The computer-readable medium as recited in Claim 47, said step of generating 

2 availability data farther comprising deriving from the image data a stains value of a 

3 , ' » i< 
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1 50. The computer- readable medium as recited in Claim 49, wherein the plurality of 

2 N . . V - n 

-> en empty s value t indicates an operating room table s not occupied v, 1 1 

4 •> - «m 

b a teady status value that imh.cates the operating room table ;s not occupied and is 

6 prepared fox new occupant: 

7 a dsarx;- o:Y status \ sin . uptedatxl 

8 the occupant is not covered with a surgical drape; said 

9 a drspes-on status value that indicates the operating room table is occupied and 
• J 0 with a surgical drape 

1 s ^ v Mi ' itias iciu^o i. f . ,i^k > s 

2 ' k v >n further comprising collecting equipment opc ta testes 

3 * .vMoiht facility. 

1 .52. The computer-readable medium as recited in Claim 51, said step of generating 

2 1 ' * iti ! .o > s < \ tt» $g whether a patient is connected to a heart 

3 ^ ' n 1 - s P -ss tc; >n an output from the heart monitor. 

1 :53 5 S5: computer-readable medium as recited in Claim 5.1 , said step or generating 

2 avaslabsii} -V d3ia fanher comprising deriving from foe equipment operation data a status 

3 value of a plurality of status values. 

; 54. The computer-readable medium as recited in Claim 53, wherein the plurality of 

2 -arm- m emprises; 

3 s >elba nritcatesp, „ ^ ej ! ss ot steeled m„ 

4 vital signs monitor; 

5 8 vi^i-stgas-on status vahte that indicates patient vital signs vital are detected by 

6 the vita; signs monitor; 

a pre-irteision stums value that indicates a surgeon has not started an incision with 

8 cine tool; an 



9 



10 electric tool. 
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^ \' >oa <n> 

2 \u ^ v ^ <. < » kd iVa h nhvi i ^ i 

3 umbo;.;! modifying operation < equipment and without modifying v> i i u s 

4 w<th the eusnguuvt 

1 The v < . medium as recited , Ciarm ^ , .< v of collecting 
- rising capturing network data traffic fee 

3 equipment 

! e con - Rum as recited in < >5, said step of cotiectm; 

2 equipment operation data further comprising measuring at least one of eleeirmmagoestc 
-> 'V f ! ! \ <i iD'i from the equipment, 

x <• j m Claim * m d" ^ i u n 

2 equipment operation data further comprising collecting vital signs data from at least one 

h of a heart monitor < o blood oxygen monitor. 

1 59. The compute-readable medium as recited in Claim 5 1 , said step of collecting 

2 equipment operation data further comprising measuring electromagnetic radiation from a 

3 Bo vie scalpel, 

1 60. The computer- readable medium as recited in Claim 39, wherein: 

J. execution of the one or mere sequences of instructions further causes the one or 
i < ( ><- ts V > mlhe *kJ vt s<\ \ < •« tathu 

4 indicates a planned use for the facility; ami 

5 said siep of presenting the coordination data farther comprises presenting a 
u > u . * <.< n u i s t i i i , 

1 61. The computer-readable medium as recited m Claim 60, said step of presenting a 

2 ^ - t ) 'i'Tou\Mj 1 .k te> le ,ouu en *m 

3 step of presenting a .first progress bar. for elapsed time based on the availability data, 

4 ( *,r >s - v ^ C cs > U Si. ^ < » Us 
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1 62 T xpufer-read »m as recited in Claim 39, said st 

2 * l ^ ti v i 0 „ c , 

3 system 1 cat? xi j e fecU.it> 

t v ^ v v. ! J IIP M,'^J-,jrw-i Si* 

2 wvivs^i , \ - mp~^ - t k stop* of 

3 e«x nmk coordination < ngibk 

4 system; and 

5 presenting display elements of the coordination data based on the user mem:. 

1 v >v i s is - v, ! - uvs .np < 

2 comprises a tnamsaHy raoveabk t ngible s> stem 

1 ? ova in a- e, ft j 

2 >VE « token on the fas bk systen s a mamiaJ switch that indicates at least torn 



1 66 The computer- readable medium as recited in Claim 62 wherein; 

2 execuHoxi of the one at more sequences of instructions fuxtbei causes She one or 

3 more processors to perform the step of detecting user ujput for conditions 

4 data; and 

5 said step of generating availability data farther comprises generating availability 
<y data based at least in part on the user input. 

! < - as recited in Claim 6 ^^ 3 opt detecting user 
2 > kh ;abh soker on me 



2 s bgp cess g an imag » cent of the 

2 systen t bowi 
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69 ^ on ^ s ! K ( fv r 

' ' ^ U f. s - v 

processors ;•> perform the steps of: 
capturing an original image; 

performing tow pass spatial 5!termg m the image to produce a low-passed Image; 

^ ' 1 <• ^ 1 ^ am e 

in the original image to a first single color: and 
« 5 - e with pixels of the st singk cotor at eaei c 

location where a color of a pixel froi I i s e fell* within 
11 the first range of colors, 

; ' iier-readab icdium carrying one or more s« i 

£ tJK f ito\ 1 v.k a i o uroi nae 

1 > ° x Qne or snore processors causes the one or more processors to 

4 perform the steps of: 

5 presenting a first bar tot indicates time for planned use of a facility; ami 

6 presenting a second bar for elapsed time of actual use of the facility, wherein the 

7 second bar extends at least m part outside the first bar. 

1 x " * * M * d ntxi carryiag oae or jnore sequences of msimcuons for 

2 inputting data to a computer connected to a video input, wherein execution of die one or 
5 Vo v ^ to- K Sx - s « 1 ^ v '- ne w more processors causes the one or more 

4 (. v S 

~ ><= f e of a two di sensiona surface inc - ui > 

* s v - ^ r v em at least one of a location and an 

N . » , to i Ui t s s.t ^ - < o * 'j;es 

5 greater than two states; and 

9 " ' ^ st k ofjvpljrahtv crst.tesibjMdon ievi&ohmge 
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2 v Nt multiple party use of a facility, wherein execution of me one or moxe 

3 s ~ v ^ ^ v v. v V V V • ^ \ s- s v 

4 perform the steps of: 

5 educing conditions t si < t i < tsa current 

6 hichttseiscoi p uc ii t> o 

7 human parties, including 

8 collecting image date depicting at kasi a portion of the facility, and 

i I f tl i 1 C S i x U £ 

\<i utilised in the i u. i> , a H > ^ , , «!ite 

12 equipment, 

'3 * > ■> ^ ' S • At least om ot n,uu , , v «t a 

1 4 surgical operating room, and a cardiac catheterization laboratory 
:i 3 and the plurality of parties include a plurality of medical doctors, 

nurses, medical technicians and orderlies: 

1 7 recei ving schedule data that indicates a planned use for the facility; 

15 generating availability data that indicates availability for the facility based at least 
19 in part on ;he conditions data, including 

2$ sits ve data, 

21 generating a plurality: of views with different levels of detail of the 
eluding denvin ta a carto 

23 i d died <>h^>e ion, s w near v ot 

24 in the image data, 

26 values, 

2'' ! i ' ! Le o:\-. SvCs.ui 

25 > x < , 

2$ ^ " tv om,e < i - -i > i v.sta^cofa 

-° N ' ' miunhe 

32 o ^ n 5 

32 <• ■> s i < - a £ _ ^a t , 



wo imsmsm 



\ t : 

33 v. j Js N I 

34 based on the party; 

33 i < , { ' . s ok 

36 _ , r ; b 

37 ^ v t < s x v s 

38 ca ^ Svx \ 

39 of privilege, 

40 presenting a display element &at indicates a deviation from the planned 

42 presenting the particular fitfure rime for the particular subsequent stage of 

- i ie facility 
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FIG.7A 

700 FACILITY COORDINATION METHOD DETAIL 

Si 
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CAPTURE RAW IMAGE DATA FOR OPERATiNG ROOM 



Jl 



'30 

GENERATE CARTOON IMAGE . BASED ON RAW IMAGE DATA 
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FIG.8A 

800 FACfUTY COORDINATION METHOD DETAIL 
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